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DEVICE FOR RECORDING INFORMATION IN DIFFERENT MODES 



Field of the Invention 

The present invention relates to a device for 
recording information of the type mentioned in the 
preamble to the appended claim 1. 
5 Background of the Invention 

In recent years, the use of computers has increas- 
ed among many very geographically mobile occupational 
groups. One reason for this is that one can work more 
efficiently by having direct access to a large amount 
10 of information while at the same time having good cap- 
abilities for processing new information simply and 
efficiently . 

For this purpose, various types of portable com- 
puters have been developed. Equipped with suitable soft- 

15 ware, these types of computers provide excellent capabi- 
lities for processing and managing information in text 
as well as image format. 

A drawback of these portable computers is that 
inputting information by the intermediary of a key- 

20 board is often time-consuming in comparison with the 

time required for processing the information once it has 
been fed into the computer. In order to achieve faster 
and more efficient inputting, there have been attempts 
at finding simpler ways of feeding the information into 

25 the computer. In some cases, the text which is to be fed 
into the computer is replaced by a numerical code, for 
instance in the case of vehicle inspections. However, 
this requires more of the user, who has to keep track of 
several codes, which increases the risk of input errors. 

3 0 In the daily work of many occupational groups there 

is a need for a simple way of putting together image and 
text information. Examples of this include various types 
of service and maintenance staff who work from some type 
of protocol and who wish to verify that a certain opera- 
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tion has been carried out; policemen at the site of an 
accident who wish to gather image data as well as per- 
sonal data concerning witnesses, etc.; and researchers 
and other individuals whose work involves information 
retrieval and who wish to put together text and images 
from a number of different written documents. 

In order to achieve more efficient inputting of 
information in these and similar situations one could 
use other input units, such as a scanner which records 
text information from a surface when it is passed over 
the same and a digital camera which takes pictures and 
stores them digitally so that they can be transferred 
to a computer for processing. 

Scanners of both the stationary and the portable 
type are available. Stationary scanners are preferably 
used in connection with the recording of whole pages with 
printed text and image information, the scanner being 
passed over the page at a constant speed. The information 
is recorded by means of a light-sensitive sensor, which 
in stationary scanners often consists of a line sensor. 

However, in most of the above situations, rather 
than the recording of a whole page of information a more 
selective recording of information is desired and, more- 
over, the scanner must also be easy to carry. For this 
reason, scanners of the hand-held type are much more 
interesting in these contexts. The sensors in these scan- 
ners can be either of the line type or of the two-dimen- 
sional type. 

US 4,949,391, for example, discloses a hand-held 
scanner for recording text. The scanner has a two-dimen- 
sional sensor, which records images of the underlying 
surface when the scanner is passed over the same. 

Another hand-held scanner is described in US 
5,301,234. This scanner utilises a line sensor which 
records a sequence of vertical 11 slices" of the characters 
and of the spaces between them when the scanner is passed 
over the characters on the substrate. The "slices" are 
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stored in the scanner as a digital bitmap. To enable the 
accurate recording of characters, the scanner is provided 
with position means in the form of a wheel which must be 
in contact with the underlying surface in connection with 
the recording of the characters to record the position of 
the scanner relative to the surface. 

A drawback of using a computer, a scanner, and a 
digital camera at the same time is that the equipment 
becomes bulky and the user has to handle several units. 

Thus, there is a need for equipment which is easy 
to handle, enabling fast and reliable recording of selec- 
tive text and image information in situations of the kind 
described above in a format facilitating computer pro- 
cessing of the same at a later time. 
Summary of the Invention 

The object of the present invention is to provide a 
solution to the above-mentioned problems by providing an 
improved device for recording information in text and 
image format . 

This object is achieved according to the invention 
by a device having the features recited in the appended 
claim 1, with preferred embodiments in the appended 
claims 2-14 . 

The invention is based on the understanding that 
with a light-sensitive sensor with a two-dimensional 
sensor surface as the starting-point, a text recording 
function, i.e. a "scanner function", as well as an image 
recording function, i.e. a "camera function", can be 
easily created in one and the same device. More 
specifically, the device is adjustable between a first 
mode, in which the device is adapted to essentially abut 
against and be passed over a surface for imaging the same 
by means of a plurality of images, and a second mode, in 
which the device is adapted to image an object located at 
a distance. 

The device can be adjusted by the user or automati- 
cally by the device if, for example, it detects that the 
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distance to an object within its field of vision changes 
more than a predetermined value. The adjustment involves 
the adaptation of the device in some manner, e.g. physi- 
cally or with respect to software, to make it suitable 
for use in the mode in question. 

The first mode, or the "scanner mode 1 ', is intended 
for recording information located on a surface over which 
the device can be passed. The surface need not be plane. 
It is sufficient that it is even enough to enable the 
device to be moved in contact with the surface or direct- 
ly adjacent to the same. The information, which can be 
said to be "two-dimensional" since it is located on a 
surface, can be composed of character sequences, e.g. one 
or several words or one or several sentences selected 
from a longer text. The characters can be letters, num- 
bers, or other written characters or symbols. It is pre- 
ferably stored in character-coded format. However, the 
information may also be composed of image information 
which is scanned by passing the device over the surface 
and recording a plurality of images of the image informa- 
tion. 

The second mode is preferably used for recording 
"three-dimensional" information, i.e. when one is requir- 
ed to take pictures of objects. Preferably, in this mode, 
individual pictures are taken which are stored in image 
format. Naturally, this mode can also be used for taking 
pictures of surfaces from a distance, which are stored in 
image format . 

Preferably, the same sensor is employed in both the 
first and the .second mode, but it is also possible to use 
one sensor for each mode. In the latter case, the adjust- 
ment would involve changing the beam path in the device 
so that the imaging takes place with the aid of one sen- 
sor in the first mode and with the aid of the other sen- 
sor in the second mode. The beam path can be changed by 
adjusting one or more components in the device. Alterna- 
tively, a first opening with a first fixed beam path can 
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be used in the first mode, and a second opening with 
a second fixed beam path can used in the second mode. 
Adjusting between the modes then comprises an adjustment 
of which sensor is activated for imaging. 

It should be noted in this context that a two-dimen- 
sional sensor surface refers to the fact that the sensor 
surface must be able to image a surface with a matrix of 
pixels so that images with overlapping contents can be 
recorded . 

Preferably, in the first mode, images with partially 
overlapping contents are recorded. The overlapping con- 
tents are used to put together the images to form a com- 
posite image, in which there is no duplication of con- 
tent. Suitably, the putting- together is carried out with 
the aid of a signal -processing unit which, for example, 
may contain software for this purpose. By virtue of the 
fact that the overlapping content is used for putting 
together the images, the device need not contain any 
means, e.g. wheels, for recording the position of the 
device relative to the surface which is being imaged or . 
for measuring the distance between the images. Moreover, 
the device can be moved at varying speeds while still 
permitting the images to be put together into a composite 
image . 

The putting- together of the images is preferably 
carried out horizontally as well as vertically. This has 
the advantage that the device can be held at different 
angles and even be turned while being passed over the 
surface and yet the images can be put together well 
enough that the characters in the composite image can be 
identified and OCR processed. 

The signal -processing unit preferably comprises 
software for identifying characters in the composite 
image and for storing the same in the device in charac- 
ter-coded format, preferably ASCII code. The character 
identification is advantageously carried out with the aid 
of a neural network. Storing in character-coded format 
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requires considerably less memory space than if the same 
amount of information is stored, for example, as a bitmap 
image . 

In order to project onto the sensor surface a clear 
image of the information to be recorded, i.e. the surface 
over which the device is passed in the first mode, or of 
the object located at a distance in the second mode, the 
device preferably comprises at least one lens means, 
which is adjustable between a first position in the first 
mode and a second position in the second mode. In this 
way, two foci are provided for the device, i.e. two dif- 
ferent imaging distances each providing a sharp image on 
the sensor surface. One focus is preferably used in the 
first mode where an object is located adjacent to the 
device and the other is preferably used in the second 
mode where an object is located at a distance from the 
device. The second position can suitably allow imaging of 
objects- -at distances of between 0.5 m and infinity. The 
different foci enable imaging of surfaces or objects at 
different distances from the device. The lens means may 
comprise one or more adjustable lenses. The device may 
contain one or more fixed lenses in addition to the one 
or more adjustable lenses. This embodiment is. intended 
in the first place for the case where the device has a 
single light-sensitive sensor which is common for both 
modes . 

In another embodiment, the device comprises a lens 
means, the position of which is variable for providing 
a variable focus or an autofocus function. This enables 
sharp imaging of an object located at an optional dis- 
tance . 

Furthermore, in an advantageous embodiment, the 
device is adapted to effect the imaging in the first mode 
with a lower resolution than the imaging in the second 
mode. This can, for example, be achieved in the first 
mode by making passive some of the sensor elements of the 
sensor or by saving only a part of the sensor values 
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which are recorded by the sensor, or by using only a part 
of the saved sensor values in the subsequent processing 
of the images, such as in connection with the putting- 
together. The advantage of this embodiment is that it 
5 is possible to achieve faster, yet reliable, putting- 
together of the images in the first mode if their reso- 
lution is lower. 

Moreover, the device advantageously comprises a 
transceiver for wireless communication with an external 

10 unit. In this way, information can be transferred between 
the device and, for example, an external computer. The 
transceiver can be an IR transceiver, a mobile radio 
transceiver, or some other suitable transceiver. 

To make the device easy to handle in all types of 

15 recording situations it is suitably of the hand-held 

type. This also expands its field of application consi- 
derably. 

In a preferred embodiment, the device also comprises 
identification means for identifying the extent of the 

20 imaging. The identification means may, for example, com- 
prise a display mounted on the device, or one or several 
luminous spots projected from the device onto the object 
for defining the extent of the imaging. By the fact that 
the user gets an idea of what the image of the object 

25 will look like once it is recorded, the chances of 

obtaining an accurate imaging result will be substantial- 
ly better. 

Brief Description of the Drawings 

The invention will be described in more detail below 

3 0 with reference to the accompanying schematic drawings 

showing, by way of example, a presently preferred embodi- 
ment of the invention. 

Fig. 1 schematically shows a first embodiment of 
a device according to the invention; 

35 Fig. 2 is a block diagram of the electronic cir- 

cuitry in an embodiment of a device according to the 
invention; 
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Fig. 3 is a flowchart showing how the device is 
intended to function in the first mode; 

Fig. 4 is a flowchart showing how the device is 
intended to function in the second mode; 
5 Fig. 5 schematically shows a second embodiment of 

a device according to the invention. 

Description of a Preferred Embodiment 
Structure of the Device 

In the embodiment of the device according to the 

10 invention shown in Fig. 1, it comprises a casing 1 hav- 
ing approximately the same shape as a conventional high- 
lighter pen. One short side of the casing has a window 2. 

In the first mode of the device, the so-called scan- 
ning mode, the window 2 is intended to abut against or be 

15 held directly adjacent to a surface which one wishes to 
image. This surface can, for example, consist of a sheet 
of paper from which text is to be recorded. In the second 
mode of the device, the so-called camera mode, the window 
is intended to be directed at an object which is located 

20 at a distance and which one wishes to image. 

The dimensions of the window 2 determine the size of 
the surface which can be imaged in the first mode. In the 
second mode, the dimensions of the window 2 only consti- 
tute a partial factor when determining which objects can 

2 5 be recorded. Another partial factor of equal importance 
in the second mode is the distance to the object which 
the user wishes to image by means of the device. 

The window 2 forms an acute angle to the longitudi- 
nal axis of the device so that in the first mode the user 

30 is guided to hold the device at a predetermined angle to 
the underlying surface. Furthermore, the window 2 is 
somewhat recessed in the casing 1 so that is does not 
wear against the underlying surface when the device is 
used in the first mode. 

35 The casing 1 essentially contains an optics part 3, 

an electronic circuitry part 4, and a power supply 5. 
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The optics part 3 comprises a light -emitting diode 
(LED) 6, an adjustable lens system 7, and a light-sensi- 
tive sensor 8 which constitutes the interface with the 
electronic circuitry part 4 . 

The LED 6 is preferably used in the first mode where 
its task is to illuminate the part of the surface which 
is currently located under the window. A diffuser 9 is 
mounted in front of the LED 6 for diffusing the light. In 
the second mode, the object being imaged is preferably 
illuminated by means of other external light sources in 
the vicinity of the object. 

The task of the lens system 7 is to project as 
accurately as possible an image of the surface located 
under the window 2, or of the object located within the 
15 field of vision of the window on the light-sensitive 

sensor 8. In connection with the adjustment between the 
two modes, the lens system 7 is moved between two posi- 
tions so that two different foci are provided. Fig. 1 
shows the lens system 7 in the first position A. The 
second position B is indicated, by way of illustration, 
by dashes extending from the lens system. The lens system 
7 can be moved in the same way as in a camera with two 
foci. Moreover, if required, the lens system 7 will 
reduce the image so that it will fit on the light-sen- 
25 sitive surface of the sensor 8. 

In this example, the light-sensitive sensor 8 com- 
prises a two-dimensional, square CCD unit (CCD = charge 
coupled device) with a built-in A/D converter. Such sen- 
sors are commercially available. In this case, the sensor 
30 8 is mounted at a small angle to the window 2 and on its 
own printed circuit board 11. 

The power supply to the device is obtained from a 
battery 12 which is mounted in a separate compartment 13 
in the casing. 

35 The block diagram in Fig. 2 schematically shows the 

electronic circuitry part 4. This comprises a processor 
20, which by the intermediary of a bus 21 is connected 
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to a ROM 22, in which the programs of the processor are 
stored, to a read/write memory 23, which constitutes the 
working memory of the processor and in which the . images 
from the sensor as well as the characters identified and 
5 interpreted in the first mode are stored, to a control 
logic unit 24, as well as to the sensor 8, the lens sys- 
tem 7, and the LED 6. 

The control logic unit 24 is in turn connected to 
a number of peripheral units, comprising a display 25, 

10 which is mounted in the casing, an IR transceiver 26 for 
transferring information to/from an external computer, 
buttons 27, by means of which the user can control the 
device, a tracer LED 28 which emits a light beam, making 
it easier for the user to follow the text, as well as an 

15 indicating device 29, e.g. a couple of LEDs, indicating 
which mode the device is in and whether or not recording 
is taking place. Control signals to the memories, the 
sensor, and the peripheral units are generated in the 
control logic unit 24 . The control logic also handles 

2 0 generation and prioritisation of interrupts to the pro- 

cessor. The buttons 27, the IR transceiver 26, the dis- 
play 2 5 and the tracer LED 28, and the LED 6 are accessed 
by the processor writing and reading in the register in 
the- control logic unit. The buttons 27 generate inter- 
25 rupts to the processor 20 when they are activated. 
Operation of the Device in the First Mode 

In the first mode, the device operates as follows. 
Suppose that a user wishes to record text from a sheet 
of paper. In this case, he holds the device against the 

3 0 sheet in the location where he wishes to start recording 

a character sequence. He presses a button 27 to activate 
the device and passes the latter over the text he wishes 
to record, following the text in the same, way as when one 
reads the text. The tracer LED 28 emits a light beam 
35 which facilitates following the lines. When the user 

activates the device, the processor 2 0 commands the LED 6 
to begin generating strobe pulses at a predetermined fre- 
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quency of 25 Hz, whereupon the sensor records images with 
partially overlapping contents which are stored in the 
read/write memory 23. However, text which is stored in 
the form of images requires a large amount of memory 
space. Consequently, to save memory space in this mode, 
the characters in the images are identified and stored 
with the aid of ASCII code. When the user has passed the 
device over the selected text or has come to the end of a 
line, he lifts the device off the sheet and releases the 
activating button, whereupon the processor 2 0 turns off 
the LED 6. When the selected text has been recorded, the 
user can control the device to show the recorded text 
on the display 2 5 or to transfer the text to an exter- 
nal computer by the intermediary of the IR transceiver 
26. The possibility of showing the scanned information 
directly on the display has proven very important since a 
user often wishes to verify that the correct information 
has been scanned. 

The flowchart in Fig. 3 shows how the device is 
adapted to work in the first mode. In step 301, images 
with overlapping contents are recorded with the aid of 
the above device and are stored in a current image area 
in the read/write memory 23 . The images are stored as 
images, i.e. with the aid of a plurality of pixels, each 
having a grey scale value in a range from white to black. 

As soon as an image has been stored in the current 
image area, the putting- together of the image with the 
previous image is suitably commenced, step 302, if such 
an image is available. If there is no previous image, the 
current image is entered directly into a line image area 
in the read/write memory. 

In order to determine how the current image is to 
be put together with the previous image so that the best 
match is achieved between the contents of the images, 
every possible overlap position between the images is 
examined, at the pixel level, and an overlap measurement 
is determined as follows: 
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1) For each overlapping pixel position, the grey 
scale values of the two relevant pixels are added up if 
the latter are not white. Such a pixel position in which 
none of the pixels are white is designated a plus posi- 

5 tion. 

2) The grey scale sums for all the plus positions 
are added up. 

3) The neighbours of each pixel position are exa- 
mined. If an overlapping pixel position is not a neigh- 

10 bour of a plus position and consists of a pixel which is 
white and a pixel position which is not white, the grey 
scale value of the non-white pixel is subtracted, pos- 
sibly multiplied by a constant, from the sum in point 2) . 

4) The overlap position providing the highest over- 
15 lap measurement as stated above is selected. In the 

resulting composite image the mean value of the grey 
scale value of the overlapping pixels is used. In this 
way, noise can be suppressed in the overlap area. The 
putting- together is thus carried out both vertically and 
20 horizontally. If it is detected that, when being put 

together, the images do not end up on a horizontal line, 
the composite image is suitably adjusted so that it 
becomes horizontal, for example by turning the composite 
image . 

25 Our Swedish patent application No. 9704924-1 and 

the corresponding US Application No. 024 641, describe 
an alternative way of matching the images in order to 
find the best overlap position. The content of these 
applications is herewith incorporated by reference. 

3 0 The composite image gradually develops in the line 

image area in the read/ write memory. It is preferred that 
the line image area be big enough to store an A4 line of 
normal typewritten text. 

In step 303, the software of the processor 20 

3 5 divides the composite image in the line image memory 
area into sub- images each containing only one charac- 
ter. The purpose of this is to create input signals to 
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a neural network software which is to interpret the char- 
acters. The division is effected by adding up the grey 
scale values of the pixels for each pixel row and each 
pixel column in the composite image. By studying the 
local intensity minima for the row sums and column sums 
thus obtained, boundaries can be determined for the 
extent of each character in the image. 

Subsequently, in step 3 04, each character in the 
composite image of the character sequence imaged is 
interpreted. The grey scale values of the pixels which 
together constitute a sub- image containing only one 
character are fed as input signals to a neural network. 
Each output from the neural network represents a charac- 
ter which the network can identify. The output from the 
network which has the highest output signal is chosen and 
the character thus chosen is stored in step 3 05 using a 
predetermined character code format, for example ASCII 
code, in the read/write memory 2 3 in a memory area for 
interpreted characters. When the character identification 
and storing in character-coded format is completed, the 
processor activates the indicating device 2 9 to inform 
the user that it is ready to record a new character 
sequence, step 306. Subsequently, it goes back to step 
301 . 

In the first mode, the steps described above are 
thus carried out by the processor 2 0 with the aid of the 
associated units and suitable software. Such software can 
be created by the skilled person with the aid of the 
above instructions. The character recognition is perform- 
ed with the aid of neural network software, which is 
adapted in a suitable manner. Neural network software is 
commercially available from, for example, MATLAB Neural 
Network Toolbox, The MathWorks Inc., 24 Prime Park Way, 
Natick, MA 01760, USA. 

Adjustment of the Devic e between the two Modes 

Suppose that the user now wishes to supplement the 
scanned text with an image of an object. In this case, 
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he indicates this by pressing the button 27. Then lens 
system is then moved to the position B. This movement 
results in the focus of the device being changed so that 
a clear image of an object located at a distance can be 
5 projected onto the light-sensitive surface of the sensor 
8 . 

Operation of the Device in the Second Mode 

In the second mode, the device operates as follows. 
The user directs the window of the device at the object 

10 which is located at a distance and which he wishes to 

image. On the display 25 of the device, the user can see 
the image which will be recorded. When the user is satis- 
fied with the appearance of the image, he presses a but- 
ton 27 to activate the device which then records an image 

15 of the object and stores the image in image format in the 
memory 22. When the image of the object has been record- 
ed, the user can control the device to either show the 
recorded image on the display 2 5 or transfer the image to 
an external computer by the intermediary of the IR trans - 

2 0 ceiver 26. The recorded image can then be supplemented 

with additional text information by the user setting the 
device to the first mode and recording text or other 
characters. Subsequently, the text and image information 
recorded can be shown either on the display 2 5 of the 

2 5 device or on an external computer. 

The flowchart in Fig. 4 shows how the device is 
adapted to operate in the second mode. In step 4 01, the 
extent of the image is indicated on the display 2 5 of the 
device. When the user is satisfied with the appearance of 
30 the image, he presses the button 27 and, in step 402, the 
image is then recorded. The image is recorded in the cur- 
rent image area of the read/write memory with the aid of 
a plurality of pixels, which can have either grey scale 
values from white to black, or colour values. The user 

3 5 can then choose whether or not he wishes to keep the cur- 

rent image. If the user decides to keep the image, the 
process continues along the solid line to step 4 03, in 
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which the image is stored in the memory 23. When the 
image has been stored, the device indicates, in step 404, 
that it is ready to scan a new image. If the user does 
not wish to keep the image, the process continues, from 
5 step 402, along the dashed line back to step 401 in order 
for a new image to be scanned. 
Alternative Embodiments 

The present invention can, of course, be modified 
within the scope of the appended claims. The lens means 

10 may, for example, comprise a lens which is put on like a 
"cap" on the front of the device in one of the modes. 

In the embodiment described above, the device has a 
single light-sensitive sensor which is used in the first 
as well as the second mode. As mentioned above, however, 

15 the device can alternatively have a sensor for each mode. 
Fig. 5 shows schematically how the embodiment in Fig. 1 
could be modified to have two sensors. In the embodiment 
in Fig. 5, the device has a second window 2' in the side 
of the casing, a second light-sensitive sensor 8 1 with a 

2 0 two-dimensional sensor surface, and a second lens means 
7» which can have a variable focus. The electronic cir- 
cuitry part is the same as in the embodiment in Fig. 1. 
When adjusting from one mode to the other, an adjustment 
takes place of which sensor is activated for imaging and 

25 an adjustment takes place of from which sensor the elec- 
tronic circuitry part collects images. 
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CLAIMS 

1. A device for recording information by means of 
5 imaging with the aid of at least one light-sensitive 

sensor (8) with a two-dimensional sensor surface, 
characterised in that 

the device is adjustable between a first mode, in 
which the device is adapted to essentially abut against 
10 and be passed over a surface for imaging the same by 
means of a plurality of images, and a second mode, in 
which the device is adapted to reproduce an image of an 
object located at a distance. 

2. A device according to claim 1, wherein said 
15 device is adapted to store information in character- 
coded format in the first mode and in image format in 
the second mode. 

3 . A device according to claim 1 or 2 , wherein the 
device comprises two light-sensitive sensors (8) with a 

2 0 two-dimensional sensor surface, one sensor being used in 

the first mode and the other sensor in the second mode. 

4 . A device according to any one of the preceding 
claims, wherein the device has a light-sensitive sensor 
which is used both in the first and in the second mode. 

25 5. A device according to claim 4, further comprising 

a lens means (7) which is adapted to project an image of 
the information onto the sensor surface (8) and which is 
adjustable between a first position in the first mode and 
a second position in the second mode for providing two 

30 different foci. 

6. A device according to any one of claims 1-4, fur- 
ther comprising a lens means (7) which is adapted to pro- 
ject an image of the information onto the sensor surface 
(8) , the position of the lens means (7) being variable 

3 5 for providing a variable focus. 

7 . A device according to any one of the preceding 
claims, wherein said device is adapted to carry out the 
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imaging of the surface in the first mode in such a way 
that the images have partially overlapping contents. 

8. A device according to claim 7, further comprising 
a signal -processing unit (20) , which is adapted to 
utilise the partially overlapping contents of the images 
for putting together the images into a composite image, 
no recording being required of the position of the device 
relative to the surface which is being imaged. 

9. A device according to claim 8, wherein the 
signal -processing unit is adapted to carry out the 
putting-together of the images horizontally as well 

as vertically. 

10. A device according to claim 8 or 9, wherein the 
signal -processing unit (20) further comprises software 
for identifying characters in the composite image and for 
storing the same in the device in character-coded format. 

11. A device according to any one of the preceding 
claims, further comprising a transceiver for wireless 
communication with an external unit. 

12 . A device according to any one of the preceding 
claims, wherein said device is adapted to effect the 
imaging in the first mode with lower resolution than the 
imaging in the second mode . 

13 . A device according to any one of the preceding 
claims, wherein said device is of the hand-held type. 

14 . A device according to any one of the preceding 
claims, further comprising identification means (25) for 
identifying the extent of the imaging. 

15. A device according to claim 14, wherein the 
identification means comprises a display (25) . 

16. A device according to claim 14 or 15, wherein 
the identification means is adapted to project at least 
one luminous spot onto the surface or the object to be 
imaged . 
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ANORDNING FOR REGISTRERING AV INFORMATION I 

Tekniskt omrade 

Foreliggande uppfinning avser en anordning f6r regi- 
strering av information av det slag som anges i ingressen 
till efterfoljande patent krav 1. 
Teknisk bakqrund 

Pa senare tid har anvandningen av datorer okat bland 
manga yrkesgrupper med stor geografisk rorlighet. En an- 
ledning till detta ar att det ar mojligt att arbeta mer 
ef fektivt om man har direkt tillgang till en stor infor- 
mationsmangd, samtidigt som man har goda mojligheter att 
enkelt och ef fektivt bearbeta ny information. 

For detta andamal har olika typer av barbara datorer 
utvecklats. Forsedda med lamplig mjukvara skapar dessa 
typer av datorer stora mojligheter till bearbetning och 
hantering av information i saval text- som bildformat. 

En nackdel med dessa barbara datorer ar att det ofta 
ar tidskravande att mata in information via ett tangent- 
bord i forhallande till den tid det tar att behandla 
informationen nar den val ar inmatad i datorn. For att 
astadkomma en snabbare och mer effektiv inmatning har man 
forsokt hitta enklare satt att mata in informationen i 
datorn. I vissa fall ersatts texten som ska matas in med 
en sifferkod, vilket exempelvis ar fallet vid besiktning 
av bilar. Detta staller dock storre krav pa anvandaren 
som maste halla reda pa ett flertal koder, vilket 5kar 
risken for f elinmatning . 

Bland manga yrkesgrupper finns det ett behov i det 
dagliga arbetet av att pa ett enkelt satt kunna koppla 
samman bild- och textinf ormation . Nigra exempel pa detta 
ar olika typer av service- och underhallspersonal som 
arbetar efter nagon typ av protokoll och vill verifiera 
att en viss atgard har utforts, poliser som vid en 
olycksplats vill samla in saval bildmaterial som person- 
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fakta om vittnen m m, forskare och andra personer som 
sysslar med litteratursokning och vill sammanstalla text 
och bilder ur en mangd olika skrifter. 

For att astadkomma en effektivare inmatning av 
5 information i dessa och liknande situationer skulle man 
kunna anvanda andra inmatningsenheter , sasom en scanner 
som registrerar textinf ormation fran en yta nar den fors 
over denna och en digital kamera som tar bilder och lag- 
rar dessa digitalt sa att de kan foras over till en dator 
10 for bearbetning. 

Scannrar finns av saval fast som portabel typ. Fasta 
scannrar anvands f oretradesvis vid registrering av hela 
sidor med tryckt text- och bildinf ormation, varvid scan- 
nern fors over sidan med konstant hastighet. Informatio- 
15 nen registreras med en ljuskanslig sensor, som i fasta 
scannrar oftast utgors av en linjesensor. 

I de fiesta av ovanstaende situationer onskas dock 
inte registrering av en hel sida med information, utan 
istallet mer selektiv inf ormationsregistrering, samtidigt 
20 som scannern maste vara latt att bara med sig. Darfor ar 
scannrar av handhallen typ betydligt mer intressanta i 
dessa sammanhang. Sensorerna i dessa scannrar kan an- 
tingen vara av linjetyp eller av tvadimensionell typ. 

I US 4 949 391 beskrivs t ex en handhallen scanner 
25 for registrering av text. Scannern har en tvadimensionell 
sensor, som registrerar bilder av den underliggande ytan 
nar scannern forflyttas over den. 

En annan handhallen scanner beskrivs i US 5 301 243. 
Denna scanner utnyttjar en linjesensor som registrerar en 
30 foljd av vertikala "skivor" av tecknen och av mellanrum- 
men mellan dessa nar scannern fors over tecknen pa sub- 
stratet. "Skivorna" lagras i scannern som en digital bit- 
mapp. For att en korrekt registrering av tecken ska kunna 
ske, ar scannern forsedd med positionsorgan i form av ett 
35 hjul som maste vara i kontakt med den underliggande ytan 
vid registrering av tecknen for att registrera scannerns 
position relativt ytan. 
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En nackdel med att samtidigt anvanda en dator, en 
scanner och en digital kamera ar att utrustningen blir 
otymplig och att anvandaren maste hantera ett flertal 
enheter . 

5 D et finns alltsa ett behov av en latthanterUg ut- 

rustning, med vilken man kan astadkomma en saker och 
snabb registering av selektiv text- och bildinformation 
i situationer av den ovan beskrivna typen i ett format 
som gor det enkelt att vid ett senare tillfalle kunna 
10 datorbearbeta den. 

s^mmanfattnina av uppfi nningen 

Andamalet med foreliggande uppfinning ar att anvisa 
en losning pa ovanstaende problem genom astadkommande av 
en forbattrad anordning for registrering av information i 

15 text- och bildf ormat. 

Detta andamal uppnas enligt uppfinningen med en an- 
ordning vilken har de sardrag som anges i efterf 61 jande 
patentkrav 1, med fdredragna utf Sringsf ormer i efterfol- 
jande patentkrav 2-14. 
20 Uppfinningen bygger pa insikten att man utgaende 

fran en ljuskanslig sensor med en tvadimensionell sen- 
soryta pa ett enkelt satt kan skapa bade en textregistre- 
ringsfunktion, dvs "scanner-f unktion" , och en bildregist- 
reringsfunktion, dvs "kamera-f unktion" i en och samma 
25 anordning. Narmare bestamt ar anordningen omstallbar mel 
lan en forsta mod, i vilken anordningen ar anordnad att 
vasentligen ligga an mot och forflyttas over en yta for 
avbildning av denna medelst ett flertal bilder, och en 
andra mod, i vilken anordningen ar anordnad att avbilda 
30 ett pa avstand belaget objekt. 

En omstallning av anordningen kan goras av anvan- 
daren eller automatiskt av anordningen om denna t ex 
detekterar att avstandet till ett objekt inom dess syn- 
falt andrar sig mer an ett forutbestamt varde. Omstall- 
35 ningen innebar att anordningen pa nagot satt anpassas, 
t ex fysiskt eller mjukvarumassigt , sa att den blir 
lampad att anvandas i den aktuella moden. 
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Den fOrsta moden, eller "scanner-moden", ar avsedd 
fOr registrering av information som befinner sig pa en 
yta som anordningen kan fOras over. Ytan behOver inte 
vara plan. Det racker att den ar sa jamn att anordningen 
kan fOrflyttas i kontakt med ytan eller omedelbart intill 
denna. Inf ormationen, som kan sagas vara "tvadimensio- 
nell" eftersom den finns pa en yta, kan utgOras av 
teckensekvenser, exempelvis ett eller flera ord eller en 
eller flera meningar som valjs i en langre text. Tecknen 
kan vara bokstaver, siffror, eller andra skrivtecken 
eller symboler. Den lagras f Oretradesvis i teckenkodat 
format. Inf ormationen kan emellertid ocksa utgoras av 
bildinformation som scannas in genom att anordningen fors 
over ytan och ett flertal bilder av bildinformationen 
registreras . 

Den andra moden anvands f Oretradesvis for registre- 
ring av "tredimensionell" information, dvs nar man beho- 
ver ta bilder av fOremal. I denna mod tas f oretradesvis 
enskilda bilder som lagras i bildformat. Denna mod kan 
givetvis ocksa anvandas for att ta bilder pa avstand av 
ytor, vilka bilder lagras i bildformat. 

En och samma sensor kan anvandas i bade den fOrsta 
och den andra moden, men det ar aven tankbart att anvanda 
en sensor for vardera moden. I det senare fallet skulle 
omstallningen innebara att stralgangen i anordningen and- 
ras sa att avbildningen sker med hjalp av den ena sensorn 
i den fOrsta moden och med hjalp av den andra sensorn i 
den andra moden. Stralgangen kan andras genom omstallning 
av en eller flera komponenter i anordningen. Alternativt 
kan en fOrsta Oppning med en fOrsta fast stralgang anvan- 
das i den fOrsta moden och en andra Oppning med en andra 
fast stralgang anvandas i den andra moden. Omstallning 
mellan moderna innefattar da en omstallning av vilken 
sensor som aktiveras fOr avbildning. 

I detta sammanhang skall papekas att med tvadimen- 
sionell sensoryta menas har att sensorytan skall kunna 
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avbilda en yta med en matris av bildpunkter sa att bilder 
med overlappande innehall kan registreras. 

I den f5rsta moden registreras f oretradesvis bilder 
med delvis overlappande innehall. Det overlappande inne- 
hallet anvands for att passa ihop bilderna till en hop- 
passad bild, i vilken det inte finns nigra dupliceringar 
av innehallet. Hoppassningen sker lampligen med hjalp av 
en signalbehandlingsenhet som t ex kan innehalla program- 
vara for detta andamal . Genom att det overlappande inne- 
hallet anvands for att passa ihop bilderna behover anord- 
ningen inte innehalla nagra organ, t ex hjul, for att 
registrera anordningens position relativt den yta som 
avbildas eller for att mata avstandet mellan bilderna. 
Anordningen kan ocksa flyttas med varierande hastighet 
och bilderna anda passas ihop till en hoppassad bild. 

Hoppassningen av bilderna sker f oretradesvis i saval 
horisontell led som i vertikal led. Detta medfor den for- 
delen att anordningen kan hallas i olika vinklar och torn 
vridas under det att den fors 6ver ytan och anda kan bil- 
derna passas ihop sa val att tecknen kan identifieras och 
OCR-behandlas i den hoppassade bilden. 

Signalbehandlingsenheten innefattar f oretradesvis 
programvara for identif iering av tecken i den hoppassade 
bilden och lagring av dessa i anordningen i teckenkodat 
format, f Sretradesvis ASCII-kod. Teckenidentif ieringen 
gors med fordel med hjalp av ett neuralt nat . Lagringen i 
teckenkodat format g6r att betydligt mindre minnesutrymme 
kravs an for motsvarande inf ormationsmangd lagrad exem- 
pelvis som en bitmappsbild. 

F6r att projicera en tydlig bild pa sensorytan av 
informationen som skall registreras, dvs den yta over 
vilken anordningen forflyttas i den forsta moden, eller 
av det pa avstand belagna objektet i den andra moden, 
innefattar anordningen f Sretradesvis minst ett linsorgan, 
som ar flyttbart mellan ett forsta lage i den fSrsta 
moden och ett andra lage i den andra moden. Harigenom 
astadkommes tva fokus f5r anordningen, dvs tva olika 
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avbildningsavstand som bada ger en skarp bild pa sensory- 
tan. Det ena anvands f oretradesvis i den forsta moden dar 
ett objekt bef inner sig intill anordningen och det andra 
fdretradesvis anvands i den andra moden dar ett objekt 
bef inner sig pa avstand fran anordningen. Det andra laget 
kan lampligen medge avbildning av objekt pa avstand mel- 
lan 0,5 m och oandligheten. De olika fokusen gor det 
mojligt att avbilda ytor eller foremal pa olika avstand 
fran anordningen. Linsorganet kan utgoras av en eller 
flera linser som ar flyttbara. Anordningen kan innehalla 
en eller flera fasta linser utOver den eller de flyttbara 
linserna. Denna utf oringsf orm ar i forsta hand avsedd for 
det fall da anordningen har en enda ljuskanslig sensor 
som ar gemensam f6r bada moderna. 

I en ytterligare utf oringsf orm innefattar anord- 
ningen ett linsorgan vars lage ar varierbart for astad- 
kommande av ett varierbart fokus eller en autofokus- 
funktion. Harigenom mojliggors skarp avbildning av ett 
objekt som bef inner sig pa ett godtyckligt avstand. 

I en fordelaktig utf oringsf orm ar anordningen vidare 
anordnad att astadkomma avbildningen i den forsta moden 
med en lagre upplosning an avbildningen i den andra 
moden. Detta kan exempelvis uppnas i den forsta moden 
genom att man passiverar endel av sensorns sensorelement 
eller genom att man bara sparar en del av de sensorvarden 
som registreras av sensorn eller genom att man i den 
fortsatta behandlingen av bilderna, sasom vid hoppass- 
ningen, bara utnyttjar en del av de sparade sensorvarde- 
na. Fordelen med denna utf oringsf orm ar att man kan 
astadkomma en snabbare, men anda saker, hoppassning av 
bilderna i den forsta moden om dessa har lagre upplos- 
ning. 

Anordningen innefattar vidare med fordel en sand- 
tagare for tradlos kommunikation med en extern enhet. 
Harigenom kan information foras over mellan anordningen 
och exempelvis en extern dator. Sandtagaren kan vara en 
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IR-sandtagare, en mobilradiosandtagare eller nagon annan 

lamplig sandtagare. 

For att anordningen ska vara latthanterlig i alia 
typer av registreringssituationer ar den lampligen av 
handhallen typ. Darmed utokas ocksa anvandningsomradet 
kraf tigt . 

I en foredragen utf oringsf orm innefattar anordningen 
aven identif ieringsorgan for identif iering av omf attning- 
en av avbildningen . Identif ieringsorganet kan till exem- 
pel utgoras av en display som ar monterad pa anordningen, 
eller av en eller flera ljuspunkter som projiceras fran 
anordningen pa objektet f6r att definiera avbildningens 
omfattning. Genom att anvandaren far en uppfattning om 
hur bilden av objektet kommer att se ut efter registe- 
ring okar chanserna for ett korrekt avbildningsresultat 
vasentligt 

Kort beskrivninq av ritningarna 

Uppfinningen kommer att beskrivas narmare i det fol- 
jande under hanvisning till bifogade schematiska rit- 
ningar som i exemplif ierande syfte visar en for narva- 
rande foredragen utf oringsf orm av uppfinningen. 

Fig 1 visar schematiskt en fSrsta utf oringsf orm av 
en anordning enligt uppfinningen. 

Fig 2 ar ett blockschema 5ver elektroniken i en 
utf oringsf orm av en anordning enligt uppfinningen. 

Fig 3 ar ett flodesschema som visar hur anordningen 
ar avsedd att fungera i den forsta moden. 

Fig 4 ar ett flodesschema som visar hur anordningen 
ar avsedd att fungera i den andra moden. 

Fig 5 visar schematiskt en andra utf Oringsf orm av en 
anordning enligt uppfinningen. 
Beskrivninq av en foredragen utf oringsf orm 
Anordningens uppbyggnad 

I den i fig 1 visade utf oringsf ormen av anordningen 
enligt uppfinningen har denna ett h61je 1 med ungefar 
samma form som en konventionell overstrykningspenna . H61- 
jets ena kortande har ett fonster 2. 
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I anordningens forsta mod, den s k scanningmoden, ar 
fonstret 2 avsett att ligga an mot eller hallas omedel- 
bart intill en yta som man onskar avbilda. Denna yta kan 
exempelvis utgoras av ett papper fran vilket man onskar 
registrera text. I anordningens andra mod, den s k 
kameramoden, ar fonstret avsett att riktas mot ett pa 
avstand belaget objekt som man onskar avbilda. 

Fonstrets 2 dimensioner avgor storleken av den yta 
som kan avbildas i den f6rsta moden. I den andra moden 
utgor fonstrets 2 dimensioner endast en delfaktor vid 
avgSrandet betraffande vilka objekt som kan registreras. 
En annan, lika viktig delfaktor i den andra moden ar 
avstandet till det objekt som anvandaren onskar avbilda 
med anordningen. 
15 FSnstret 2 bildar en spetsig vinkel med anordningens 

langdaxel, sa att anvandaren i den forsta moden styrs 
till att halla anordningen i en fSrutbestamd vinkel mot 
den underliggande ytan. Fonstret 2 ar vidare nagot indra- 
get i hSljet 1 sa att det inte slits mot den under lig- 
20 gande ytan da anordningen anvands i den forsta moden. 

H5ljet 1 inrymmer i huvudsak en optikdel 3, en elek- 
tronikdel 4 och en stromf orsor jning 5. 

Optikdelen 3 innef attar en lysdiod 6, ett flyttbart 
linssystem 7 och en ljuskanslig sensor 8 som utgor grans- 
25 snitt mot elektronikdelen 4. 

Lysdioden 6 anvands f oretradesvis i den fdrsta moden 
dar den har till uppgift att belysa den del av ytan som 
for tillfallet finns under fonstret. En diffusor 9 ar 
monterad framfor lysdioden 6 for att sprida ljuset. I den 
30 andra moden belyses objektet som avbildas f oretradesvis 
med andra externa ljuskallor i objektets omgivning. 

Linssystemets 7 uppgift ar att projicera en bild av 
den yta som bef inner sig under fonstret 2, eller det 
objekt som bef inner sig inom fonstrets synfalt pa den 
35 ljuskansliga sensorn 8 pa ett sa korrekt satt som m6j- 
ligt. Vid omstallningen mellan de bada moderna flyttas 
linssystemet 7 mellan tva lagen, sa att tva olika fokus 



1999-04-28 11:43 \\s-nam-pdc-01\groups$\pat\ch\ans\2990823__pc_(p) 1999-04-19 . doc 




4 




9 



astadkoms . I fig 1 visas linssystemet 7 i det forsta 



streckad forlangning av linssystemet. Flyttningen av 
linssystemet 7 kan goras pa samma satt som i en kamera 
med tva fokus. Linssystemet 7 forminskar vid behov aven 
bilden, sa att den ryms pa sensorns 8 ljuskansliga yta. 

Den ljuskansliga sensorn 8 utgors i detta exempel av 
en tvadimensionell, kvadratisk CCD-enhet (CCD = charge 
coupled device, laddningskoppiad anordning) med inbyggd 
A/D-omvandlare. Sadana sensorer ar kommersiellt tillgang- 
liga, Sensorn 8 ar har monterad i liten vinkel mot fonst- 
ret 2 och pa ett eget kretskort 11. 

Stromforsor jningen till anordningen erhalls fran ett 
batteri 12 som ar monterat i ett separat fack 13 i hol- 
jet . 

I blockschemat i Fig 2 visas elektronikdelen 4 sche- 
matiskt. Den innef attar en processor 20, vilken via en 
buss 21 ar kopplad till ett lasminne 22, i vilket proces- 
sorns program ar lagrade, till ett skriv-lasminne 23, 
vilket utgor processorns arbetsminne och i vilket bil- 
derna fran sensorn liksom de i den forsta moden identifi- 
erade och tolkade tecknen lagras, till en styrlogikenhet 
24, samt till sensorn 8, linssystemet 7 och lysdioden 6. 

Styrlogikenheten 24 ar i sin tur kopplad till ett 
antal perif erienheter , som innefattar en display 25, som 
ar monterad i holjet, en IR-sandtagare 26 for overforing 
av information till/fran en extern dator, knappar 27, 
medelst vilka anvandaren kan styra anordningen, en spar- 
lysdiod 28, som sander ut en ljusstrale, vilken gor det 
lattare for anvandaren att folja texten, samt en indike- 
ringsanordning 29, t ex ett par lysdioder, som indikerar 
i vilken mod anordningen befinner sig och om registrering 
sker eller e j . I styrlogikenheten 24 genereras styrsigna- 
ler till minnena, sensorn och perif erienheterna . Styrlo- 
giken hanterar aven generering och prioritering av av- 
brott till processorn. Knapparna 27, IR-sandtagaren 26, 
displayen 25 och sparlysdioden 28, och lysdioden 6 nas 



laget A. Det andra laget B ar symboliskt markerat som en 
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genom att processorn skriver och laser i registret i 
styrlogikenheten. Knapparna 27 genererar avbrott till 
processorn 20 nar de aktiveras. 
Anordninqens funktion i den forsta moden 

Anordningen fungerar i den forsta moden enligt fol- 
jande. Antag att en anvandare vill registrera text fran 
ett papper. Han nailer da anordningen mot pappret pa det 
stalle han vill borja registrera en sekvens av tecken. 
Han trycker pa en knapp 27 for aktivering av anordningen 
och drar denna over den text han vill registrera, varvid 
han foljer texten pa det satt som man gor nar man laser 
texten. Sparlysdioden 28 utsander en ljusstrale som 
under lattar radfoljningen. Nar anvandaren aktiverar an- 
ordningen, styr processorn 20 lysdioden 6 till att borja 
stroboskopera med en forutbestamd frekvens av 25 Hz, var- 
vid sensorn registrerar bilder med delvis overlappande 
innehall som lagras i las-skrivminnet 23. Text som ar 
lagrad i form av bilder kraver emellertid mycket minnes- 
utrymme. F6r att spara minnesutrymme i denna mod identi- 
fieras darfor tecknen i bilderna och lagras med hjalp av 
ASCII-kod. Nar anvandaren har fort anordningen over den 
valda texten eller kommit till slutet av en rad lyfter 
han anordningen fran papperet och slapper aktiverings- 
knappen, varvid processorn 20 stanger av lysdioden 6. Nar 
den valda texten har registrerats , kan anvandaren styra 
anordningen till att visa den registrerade texten pa 
displayen 25 eller till att f6ra over texten till en 
extern dator via IR-sandtagaren 26. Mojligheten att visa 
den inlasta inf ormationen direkt pa skarmen har visat sig 
vara mycket vasentlig eftersom en anvandare ofta vill 
verifiera att ratt information har lasts in. 

I f lodesschemat i fig 3 visas hur anordningen ar 
anordnad att arbeta i den forsta moden. I steg 301 re- 
gistreras bilder med overlappande innehall med hjalp av 
ovan beskrivna anordning och lagras i en nubildsarea i 
las-skrivminnet 23. Bilderna lagras just som bilder, dvs 
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med hjalp av ett flertal bildpunkter, som var och en har 
ett graskalevarde i ett intervall fran vitt till svart. 

Sa snart en bild ar lagrad i nubildsarean pabSr^as 
lampligen en hoppassning av bilden med den narmast fSre- 
gaende bilden, steg 302, om sadan finnes. Om det xnte 
finns nagon fSregaende bild, fors den aktuella bilden 
direkt in i en radbildsarea i las-skrivminnet . 

For att bestamma hur den aktuella bilden skall pas- 
sas ihop med den foregaende bilden sa att basta overens- 
stammelse fas mellan innehallet i bilderna, undersSks 
varje tankbar overlappningsposition mellan bilderna, sett 
pa bildpunktsniva, och bestams ett Sverlappningsmatt 

enligt foljande: 

1) For varje overlappande bildpunktsposition summe- 
ras graskalevardena for de bada ingaende bildpunkterna om 
dessa inte ar vita. En sadan bildpunktsposition i vilken 
ingen av bildpunkterna ar vita betecknas en pluspositxon . 

2) Graskalesummorna for alia pluspositioner summe- 

ras. 

3) Grannarna till varje bildpunktsposition under- 
soks. Om en overlappande bildpunktsposition inte ar gran- 
ne till nagon plusposition och bestar av en bildpunkt 
som ar vit och en bildpunktsposition som inte ar vit sub 
traheras graskalevardet f<Jr den icke-vita bildpunkten, 
eventuellt multiplicerat med en konstant, fran summan 

under punkt 2) . 

4) Den overlappningsposition som ger det hogsta 
overlappningsmattet enligt ovan valjs. I den resulterande 
hoppassade bilden anvands medelvardet av graskalevardet 
for de overlappande bildpunkterna. Pa detta satt kan brus 
undertryckas i overlappningsomradet . Hoppassningen sker 
alltsa i bade vertikal och horisontell led. Om det detek- 
teras att bilderna vid hoppassningen inte hamnar pa en 
horisontell linje, injusteras den hoppassade bilden lamp- 
ligen sa att den blir horisontell, exempelvis genom vrid- 
ning av den hoppassade bilden. 
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I var svenska patentansokan nr 9704924-1 och mot- 
svarande amerikanska ansokan nr 024 641 beskrivs ett 
alternativt satt att matcha bilderna for att hitta den 
basta overlappningpositionen. Innehallet i dessa ansok- 
ningar inkorporeras harmed i denna ansokan. 

Den hoppassade bilden vaxer fram efterhand i rad- 
bildsarean i las-skrivminnet . Det foredras att radbilds- 
arean ar sa stor att den kan lagra en A4-rad av normal 
maskinskriven text. 

I steg 303 delar processorns 20 programvara in den 
hoppassade bilden i radbildsminnesarean i delbilder som 
var och en innehaller endast ett tecken. Syftet med detta 
ar att skapa insignaler till en neuronnatsprogramvara som 
skall tolka tecknen. Indelningen gors genom att for varje 
bildpunktsrad och varje bildpunktskolumn i den hela bil- 
den summera graskalevardena for bildpunkterna . Genom att 
studera de lokala intensitetsminimumen for de erhallna 
radsummorna och ko lumn summer na kan granslinjer for varje 
teckens utstrackning i bilden bestammas. 

I steg 304 tolkas sedan varje tecken i den hoppas- 
sade bilden av den avbildade teckensekvensen. Graskale- 
vardena for de bildpunkter som tillsammans utge-r en del- 
bild som innehaller endast ett tecken matas da som insig- 
naler till ett neuralt nat . Varje utgang fran det neurala 
natet representerar ett tecken som natet kan identifiera. 
Den utgang fran natet som har den h6gsta utsignalen valjs 
och det salunda valda tecknet lagras i steg 305 med nagot 
forutbestamt teckenkodf ormat , exempelvis ASCII-kod, i 
las-och-skrivminnet 23 i en minnesarea fSr tolkade 
tecken. Nar teckenidentif ieringen och lagringen i tecken- 
kodat format ar klar, aktiverar processorn indikerings- 
anordningen 29 for att informera anvandaren om att den ar 
redo for registrering av en ny teckensekvens, steg 306. 
Darefter gar den tillbaka till steg 301. 

I den forsta moden genomfors alltsa de ovan beskriv- 
na stegen av processorn 20 med hjalp av de tillhorande 
enheterna och lamplig programvara. Sadana program kan 
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astadkommas av fackmannen med hjalp av anvisningarna 
ovan. Teckenigenkanningen genomfors med hjalp av neuron- 
natsprogramvara, som tranas pa lampligt satt. Neuronnats- 
programvara firms kommersiellt tillganglig fran exempel- 
vis MATLAB Neural Network Toolbox, The MathWorks, Inc. 24 
Prime Park Way, Natick, MA 01760, USA. 
Omstallnina av anord ninaen mellan de bada moderna 

Antag att anvandaren nu vill komplettera den inlasta 
texten med en bild pa ett fOremal. Han indikerar da detta 
genom att trycka pa knappen 27. Linssystemet forflyttas 
da till laget B. Forf lyttningen medfor att fokus fSr an- 
ordningen andras sa att en tydlig bild av ett foremal pa 
avstand kan projiceras pa sensorns 8 ljuskansliga yta. 
Anordningens funktion i de n andra moden 

Anordningen fungerar i den andra moden enligt fOl- 
jande. Anvandaren riktar anordningens fonster mot det pa 
avstand belagna foremalet som han onskar avbilda. Pa 
anordningens display 25 kan anvandaren se den bild som 
kommer att registreras. Nar anvandaren ar nojd med bil- 
dens utseende trycker han pa en knapp 27 for aktivering 
av anordningen som da registrerar en bild av objektet och 
lagrar den i bildformat i minnet 22. Nar bilden av objek- 
tet ar registrerad kan anvandaren styra anordningen an- 
tingen till att visa den registrerade bilden pa displayen 
25 eller till att fora over bilden till en extern dator 
via IR-sandtagaren 26. Den registrerade bilden kan sedan 
kompletteras med ytterligare textinf ormation, genom att 
anvandaren staller om anordningen till den fdrsta moden 
och registrerar text eller andra tecken. Den registrerade 
text- och bildinformationen kan sedan antingen visas pa 
anordningens display 25 eller pa en extern dator. 

I flodesschemat i fig 4 visas hur anordningen ar 
anordnad att arbeta i den andra moden. I steg 401 indike- 
ras bildens omfang pa anordningens display 25. Nar anvan- 
35 daren ar n6jd med bildens utseende trycker han pa knappen 
27 och i steg 402 registreras da bilden. Bilden registre- 
ras i nubildsarean i las-och-skrivminnet med hjalp av ett 
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flertal bildpunkter, vilka antingen kan ha graskalevarden 
fran vitt till svart, eller ha fargvarden. Anvandaren kan 
nu valja om han vill behalla den aktuella bilden, eller 
ej. Om anvandaren bestammer sig for att behalla bilden, 
fortsatter processen langs den heldragna linjen till steg 
403, i vilket bilden lagras i minnet 23. Nar bilden ar 
lagrad indikeras i steg 404 att anordningen ar klar for 
inlasning av en ny bild. Om anvandaren inte vill behalla 
bilden fortsatter processen efter steg 402 langs den 
streckade linjen tillbaka till steg 401 for inlasning av 
en ny bild. 

Alternativa utf oringsf ormer 

Foreliggande uppfinning kan naturligtvis modifieras 
inom ramen for de ef terf 61 jande patentkraven. Linsorganet 
kan t ex utgoras av en lins som satts pa som en "mossa" 
framme pa anordningen i den ena moden. 

I ovan beskrivna utf oringsf orm har anordningen en 
enda ljuskanslig sensor som anvands i bade den forsta och 
den andra moden. Sasom namnts kan emellertid anordningen 
alternativt ha en sensor for vardera moden. I fig 5 visas 
schematiskt hur utf oringsf ormen i fig 1 skulle kunna 
modifieras till att ha tva sensorer. I utf oringsf ormen i 
fig 5 har anordningen ett andra fonster 2' i sidan av 
hoi jet, en andra ljuskanslig sensor 8' med tva-dimensio- 
nell sensoryta, och ett andra linsorgan 7' som kan ha 
varierbart fokus. Elektronikdelen ar densamma som i ut- 
f oringsf ormen i fig 1- Vid omstallning fran den ena till 
den andra moden, sker en omstallning av vilken sensor som 
ar aktiverad for avbildning och en omstallning av fran 
vilken sensor elektronikdelen hamtar bilder. 



11:43 \\s-ml«-pdc-01\«roupsS\paT:\ch\ans\2990828_j>c_(p) 1999-04-19. 



15 



4 



PCT/ SE9 9 / 0 07 1 5 
3 0 -04- 



PATENTKRAV 

1. Anordning for registrering av information genom 
5 avbildning med hjalp av minst en ljuskanslig sensor (8) 
med en tvadimensionell sensoryta, 
kannetecknad av 

att anordningen ar omstallbar mellan en forsta mod, 
i vilken anordningen ar anordnad att vasentligen ligga an 
10 mot och forflyttas over en yta for avbildning av denna 
medelst ett flertal bilder, och en andra mod, i vilken 
anordningen ar anordnad att avbilda ett pa avstand bela- 
get objekt. 

2. Anordning enligt krav 1, varvid anordningen ar 
15 anordnad att i den forsta moden lagra inf ormationen i 

teckenkodat format och i den andra moden i bildf ormat . 

3. Anordning enligt krav 1 eller 2, varvid anord- 
ningen innefattar tva ljuskansliga sensorer (8) med tva- 
dimensionell sensoryta, varvid den ena sensorn anvands i 

20 den forsta moden och den andra sensorn i den andra moden. 

4. Anordning enligt nagot av foregaende krav, varvid 
anordningen har en ljuskanslig sensor som anvands i bade 
den forsta och den andra moden. 

5. Anordning enligt krav 4, vidare innefattande ett 
25 linsorgan (7) som ar anordnat att projicera en bild av 

informationen pa sensorytan (8) och som ar flyttbart 
mellan ett forsta lage i den forsta moden och ett andra 
lage i den andra moden for astadkommande av tva olika 
f okus . 

30 6. Anordning enligt nagot av krav 1-4, vidare inne- 

fattande ett linsorgan (7) som ar anordnat att projicera 
en bild av informationen pa sensorytan (8), varvid lins- 
organets (7) lage ar varierbart f6r astadkommande av ett 

varierbart fokus. 
35 7. Anordning enligt nagot av foregaende krav, varvid 

anordningen ar anordnad att i den forsta moden utfora 
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avbildningen av ytan pa sa satt att bilderna har delvis 
overlappande innehall. 

8. Anordning enligt krav 7, vidare innefattande en 
signalbehandlingsenhet (20), sora ar anordnad att utnyttja 
det delvis overlappande innehallet i bilderna ffir hop- 
passning av bilderna till en hoppassad bild, varvid ingen 
registrering av anordningens position relativt den yta 

som avbildas kravs . 

9. Anordning enligt krav 8, varvid signalbehand- 
lingsenheten ar anordnad att utfSra hoppassningen av bil- 
derna i saval horisontell led som i vertikal led. 

10. Anordning enligt krav 8 eller 9, varvid signal- 
behandlingsenheten (20) vidare innefattar programvara for 
identifiering av tecken i den hoppassade bilden och lag- 
ring av dessa i anordningen i teckenkodat format. 

11. Anordning enligt nagot av f5regaende krav, 
vidare innefattande en sandtagare for tradlOs kommuni- 
kation med en extern enhet . 

12. Anordning enligt nagot av foregaende krav, var- 
vid anordningen ar anordnad att astadkomma avbildningen i 
den forsta moden med lagre upplosning an avbildningen i- 

den andra moden. 

13. Anordning enligt nagot av foregaende krav, var- 
vid anordningen ar av handhallen typ. 

14. Anordning enligt nagot av foregaende krav, 
vidare innefattande identif ieringsorgan (25) f6r identi- 
fiering av omfattningen av avbildningen. 

15. Anordning enligt krav 14, varvid identif ierings- 
organet utgors av en display (25) . 

16. Anordning enligt krav 14 eller 15, varvid iden- 
tif ieringsorganet ar anordnat att projicera minst en 
ljuspunkt pa ytan eller objektet som skall avbildas. 
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En anordning for registrering av information har 
5 minst en ljuskanslig sensor (8) med en tvadimensionell 
sensoryta. Anordningen ar omstallbar mellan en forsta m. 
och en andra mod. I den forsta moden ar anordningen an- 
ordnad att vasentligen ligga an mot och forflyttas over 
en yta fdr avbildning av denna medelst ett flertal bil- 
10 der. I den andra moden ar anordningen anordnad att av- 
bilda ett pa avstand belaget objekt. 
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30 Publiceringsbild = Fig 1 
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FIG 4 
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